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BEST AVAILABLE IMAGES 



Defective images within this document are accurate representations of 
the original documents submitted by the applicant. 

Defects in the images may include (but are not Hmited to): 



BLACK BORDERS 

TEXT CUT OFF AT TOP, BOTTOM OR SIDES 
FADED TEXT 
ILLEGIBLE TEXT 
SKEWED/SLANTED IMAGES 
COLORED PHOTOS 

BLACK OR VERY BLACK AND WHITE DARK PHOTOS 
GRAY SCALE DOCUMENTS 



IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 
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Main Application 



Click on switch with event 
session assigned to it 



Click on done switch 



^^^^^^^ socket 

Start as slave with top 
left coordinates 



►Viewer 



Connect to socket 
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and initial conditions 



Play event session 
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Done 




Bring to front of 
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Unload session 
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Figure 21 
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Save initial conditions of a computer environment 



Record user inputs to the computer environment 



Figure 23 



Load recorded initial conditions of a computer environment 
into a replay computer environment 



Apply recorded user inputs to the replay computer 
environment 
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Event 
Recorder 
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Figure 25 
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Receive a user command for entering a synchronization point 
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Is event session active and playing? 
Does the event session contain audio? 
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Find the session control object for this session 
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Obtain the current session time 
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Create a synchronization point data structure for this time 
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Add the data object to the session list 
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Is a linear timeline visible on screen? 
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Add marker to the timeline 
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Send message to sound player that a new synchronization point 
has been created 
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Figure 27 



Receive a message that a new synchronization point has been 

created 
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Extract the type, time and id of the synchronization point from 
the message 
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Is there an existing entry in the 
sound player event list with the 
same id? 
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Add an entry in the sound player event list containing the type, 
time and id extracted from the message 
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Figure 2 



Detect a positional change of a marker on the timeline 
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Is the marker a synchronization 
point marker? 
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Conduct a search to find the session control object which 
contains the marker data 
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Session control object found? 
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Etoes diis session control object have data 
for a marker of this time and type? 
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Alter the data stored in the session control object to reflect the 
new time for this marker 
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Send a message to the sound player to notify the player of the 
change in marker time 
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Figure 29 



Receive a message that an existing synchronization point has 
been edited 
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Extract the type, time and id of the synchronization point from 
the message 
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Is there an existing entry in the 
sound player event list with the 
same id? 
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Alter the entry in the sound player event list for the edited 
synchronization point with the new event time 
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Process audio at a current audio time value 
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Is there an action to perform at this 
time value? 




Is the action a synchronization point? 
V ^ 



Find the latest EV time value 




Perform other action 
processes 
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"Does the difference between the latest^. 
EV time value and the current audio time 
value exceed a predefined amount 
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Pause the audio 
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Set this action as "active" 
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Is there an "active" action? 
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Is it a synchronization point? 
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Find the latest EV time value 

Does the difference between the 
latest EV time value and the current 
audio time value exceed the predefined 
amount? 
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Resume normal playback 
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Set this action as "not active" 
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Perform other action 
processes 
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Figure 3 1 



Replay operations in a computer environment with 
accompanying audio 
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Create a synchronization point at a conunon point in the replay 
of the operations and the accompanying audio 
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Associate the synchronization point with the accompanying 

audio 
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Figure 32 



Replay operations in a computer environment and accompanying — 335 

audio 
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Detect a synchronization point during the replay of the 
accompanying audio 
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Compare the synchronization point with a time value associated 
with processing of recorded user inputs 



I 



Selectively pause the replay of the accompanying audio if a 
difference between the synchronization point and the time value 
exceeds a predefined amount 
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Figure 33 



